Anatomy-Aware 3D Human Pose Estimation With Bone-Based Pose Decomposition
نویسندگان
چکیده
In this work, we propose a new solution to 3D human pose estimation in videos. Instead of directly regressing the joint locations, draw inspiration from skeleton anatomy and decompose task into bone direction prediction length prediction, which locations can be completely derived. Our motivation is fact that lengths remain consistent across time. This promotes us develop effective techniques utilize global information all frames video for high-accuracy prediction. Moreover, network, fully-convolutional propagating architecture with long skip connections. Essentially, it predicts directions different bones hierarchically without using any time-consuming memory units (e.g. LSTM). A novel shift loss further introduced bridge training networks. Finally, employ an implicit attention mechanism feed 2D keypoint visibility scores model as extra guidance, significantly mitigates depth ambiguity many challenging poses. full outperforms previous best results on Human3.6M MPI-INF-3DHP datasets, where comprehensive evaluation validates effectiveness our model.
منابع مشابه
Structure-Aware and Temporally Coherent 3D Human Pose Estimation
Deep learning methods for 3D human pose estimation from RGB images require a huge amount of domain-specific labeled data for good in-the-wild performance. However, obtaining annotated 3D pose data requires a complex motion capture setup which is generally limited to controlled settings. We propose a semi-supervised learning method using a structure-aware loss function which is able to utilize a...
متن کاملUnsupervised Geometry-Aware Representation for 3D Human Pose Estimation
Modern 3D human pose estimation techniques rely on deep networks, which require large amounts of training data. While weaklysupervised methods require less supervision, by utilizing 2D poses or multi-view imagery without annotations, they still need a sufficiently large set of samples with 3D annotations for learning to succeed. In this paper, we propose to overcome this problem by learning a g...
متن کامل2D-3D Pose Consistency-based Conditional Random Fields for 3D Human Pose Estimation
This study considers the 3D human pose estimation problem in a single RGB image by proposing a conditional random field (CRF) model over 2D poses, in which the 3D pose is obtained as a byproduct of the inference process. The unary term of the proposed CRF model is defined based on a powerful heat-map regression network, which has been proposed for 2D human pose estimation. This study also prese...
متن کاملRobust 3D-3D pose estimation
The paper focuses on the robust 30-30 single and multiple pose estimation. The robust 30-30 single pose estimation was formulated aa a general regression in terms of a contaminated Gaussian error noise model (Haralick et al., 1989). The robust 30 -30 multiple pose estimation appears much more dificult. In the paper, the problm is formulated as a series of general regressions involving a success...
متن کاملConditional Models for 3d Human Pose Estimation
OF THE DISSERTATION Conditional Models for 3D Human Pose Estimation by ATUL KANAUJIA Dissertation Director: Dimitris Metaxas Human 3d pose estimation from monocular sequence is a challenging problem, owing to highly articulated structure of human body, varied anthropometry, self occlusion, depth ambiguities and large variability in the appearance and background in which humans may appear. Conve...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Circuits and Systems for Video Technology
سال: 2022
ISSN: ['1051-8215', '1558-2205']
DOI: https://doi.org/10.1109/tcsvt.2021.3057267